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, eet Is ono of four-writtoq as part cr, tho projoct cal lod, Assess Iig “tho 
Qual lty of tho HEGIS“Data. Tho projoct was. Suppor tod by tho Nutlonal Ins sti tuto: 
of Education and was designed to study problems and Issues*related 16 tho. 

. quality of the data collected through the: HIighor Education Gonekal Information: 

~ Survey (HEGIS) by tho National Contor--for Education Statistics (NCES). -Thore 
are five major surveys C4 lected annual ly, and: ‘three minor surveys collected . 
porlodically., The major "Surveys are ontitled Institutional ereretristies 
Financlal-‘Statks stics, Opening Fall Enrollment, Earned Dogroos,. and Employees. | 

_ Tho periodic .su¥veys are. ent | tod FaciIItlos, Ros isoney and fa le 
Librarles. iy ‘ : 

Frequently. HEGIS dat’ are needed to make coripar Isons , between states ,. 
between Instltutions, “and* betweon Institutional sectors. Sinco~highor . 
education, ls so diverse, comparative analysis Is often difficult. After 
i reviewing previous work done In tho aro’, thls proJoct- oxam!ned HEGI'S data for 
tholr” comparabl'lIty, ‘pollcy refevance,, accuracy, and validity. To examine 
comparability, four studies were conducted through the Data Qual ity “project: 
(1) the development of a new and Improved taxonomy for col leges and ; 
_ universities; (2) a study: Investigating,the Impact of medical.schools on the 
2... financial statistics reported by Institutions; (3) a survey of state practices 
affecting the reporting of HEGIS data; and (4) an assessment of longitudinal 
_changes .In the reporting units of the HEGIS universe.’ To examine policy 
“relevance, the project studied the utility. of-the data from.a researcher's 
' perspective. To examine accuracy and validity, the project conducted a study, 
7 that suggested NCES ceuld Improve the accuracy of the data by mort extensive 
‘verl fication checks ddenrity ing out lying: TDS TNUE FOO through cross~survey. 
measures. 


. Four Reparte arebeing made aval table to any Interested partys. tne are s piaecae 


~sHsted ‘below by: title and author. : 


* "An Improved Taxonomy - -of Postsecondary Inst tut tong by-David Je 
a Makowsk | and “Rot M. Wul fsberg | Pun. ¥ P 


e "Impagt of Health Programs on Instruct onal Expenditures In Higher 
4 Educatioh" PY Jon o Smith 4 _ , 8 a ; 


a 


r ‘ 


"@ "The U lity of HEGIS Finance. oats A srr Perspective" by 
Marily McCoy = ; ys 


+ : “' , . , : a Ce 
copies: of the papers can be obtained by wr itt to: ; nie 
- Ota ‘Quallty ales - os # _ 4 hat gy 
NCHEMS - : ge 4 es 8 a ae 
P. ee a ere eee ee taee. 
Boulder, Coforado. oe ° are ee — _ : 
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1979 edition of 
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' Sinco’ 1966, Aig feionele stuner ‘for Paueahiea Statistics (NCES) ‘(as .col' lactad 


.y Intormatton on financlaf statistics: of highorwodicati on Insti tutlons. as ‘part of 


a comprohons ive survey systom Known ag tha Highor? Education Gonoral information 
. Syston (HEGIS). It Nas-long been, recognized that reporting procaduros , and 
‘ practices vary ,sign jfitantly jfrom s state.to state. This varlanco advorsely 
_affocts the quality‘of the data ropor ted from tho ‘standpoint of data 
“comparab || Ity amohg states and among Institutions. In 1973, NCES sponsor od a. 
working group whose membérs ropresonted throe natlonal organizations, Tho 
‘Amocican Instituto: of Cértif lod Public Agcountants ‘(AICPAY, tho National °, 
Assdclation of" Col logo\and Univorsity Businoss Off Icors (NACUBO), ahd tho 
Natlonal, Contor: for’ Highor Education Managompnt Systoms “(NCHEMS).. This ‘¢ ‘group. 
‘doveloped common, dof Initlions ‘and data, tPuchiroe for financial reporting, ane 

_ In'1975, NCES adopted those dof Initians and data. structures for Its annual | 
col lettion of. data,on current, funds,. expendi turés, and revenues. With thet: 
‘exception of minor reylsions, the def Initions ‘and structures. adopted: by NOES In 
.1975 have remained unchanged. Tho report 1 ni¥ conventl ons and practicos In many 
states: and, Inst} tut! ons%!, however, are still: not: univorsal ly consistent with tha 
‘adopted standards.: Ungagy ont | onal. practices aro not continuod arbitrarily. 

. They are generally the RON + of légitimate differences from,state to state Jn . 
_ Strategles for funding d. ‘financing postsecondary | education. When a state | : 
», funds | specific’ programs dirgchty through Institutions, th. Information Is \ 
.jreadtly available for report'{ng, but when similar programs,.in another state are © 
fuhded from a central agency ypassing the institutions ‘rather than through tho a 
Institutions, - It IS often difMicult for - the Institutions accurately ‘to report ° 
their appropriate shares of twese programs. . ypical of such central ly inde 
‘functions ithat cause reporting ‘-varlatfons are studént ald provided. dirgéct| 
students ,,sapntral - -of fices* tnd .commiss.jons, exténs| on’ programs and fri a “8 
benef Its. tirement pa, pents. Financing arrangements that cayse d1 ‘Teulty 

as, ese: practices axieted énd- that they . 

pence and, magh I tu; Ae variations gis 


include de fsserv Ice and « alll grinene ing arrangements. 
were nat aeperenre. ‘To, addregs these \ubestd ins; aa jojnt™ fort was undertaken, 
utilizing the resources ‘of oo fask .Torce_ppoolnted, by the Postsecondary 
Educat/on Policy Committee on Informe ans the State Postsecondary Personne! | 
Exchange Program ‘of -the SHEEO/NCES »Conf Fcation: Network operated by the State. 
igfder a-contract from NCES, the National 
Center’ for Higher. Education aft Systems (NCHEMS), and the Washington 
Counct| for Postsecondary ,Edut, ‘a fon? A ‘survey: was formulated by’ NCHEMS, ) 
reviewed ard modified *by the @#=hoc- task} force, ‘and sent to the states by the - 
Washington | Councli. The. task’ force: discéssée the survey results and devéloped /. 
recommandat|ons that, are. ihc luda’ In: a‘ report drafted by the - NE nth Network 
Office. The.survey results fe also belng used by NCHEMS- ‘and NIE In the FY \. 
; to improve’ the 

ompar,|sons. The © surve results and the ; 
e: ‘SHEEO/NGES nonvetss roves are the basis r 


/ ined Tt was: . known, that many, 
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y Rola ofthe States In Proylding HEGIS ‘Data 


Tha role ef the states In collecting HEGIS data from the Insti tut lons : 
? prior to trinsmisston to NCES can affect the quality of the reported data. 
Evidence.of state Interest In and use'of tho HEGIS data can be an Incentive for 
' |. Insti tuttons to report accurately. Figure 1 shows the extent of HEGIS ~~ 
coordination by stato} as of Fall 1980, all but three states (North Dakgta, 
Tonnossoe, and Yoxas) coordinate the HEGIS colloction and réporting of fort, for: 
at least somo group'of Institutions In, tho state. ‘Forty-throo of tho statos 
_ provido,a coordination function for all Institttlofs In.tho statos, whilo’ tho - 
7 othors IImIt coordinatian to only tho public Insti tuttons (Fldtida), only , 
- stato-accrodited Insti tutlons ‘(Now ‘York), or only tho state unlvorsity system id 
(Hawall, Novada, and New. Hampshire). Florida’ has soparato coord|nators for. the 
. . four-yoar and. two-yoar Institutions; Malno has ono coordIngtor for tho ; 
~ University of Malno and anothor for alt othor Institutions; and Wisconsin has | 
ono coordinator for tho unlvorsity systom und anothor for tho, 18 privato 
jnstituttons. . . . ts a 


a 
v \ = 


ry 


1 a eo : ; oe \ 
Tho large number of states acting as a condult for «the HEGYS data might 
Suggost oxtonslve stato uso of tho data, The state survby rosults, however, ‘ 
: oaled’a relatively woak state role In oditing tho data calloctod from tho * 
" y ' InskItuttons, and only moderate uso of tho data. Of those state agenclos 
responding to the survey and reporting a role.as a condult for the HEGIS data,’ 
33 percent Indicated that no editing whatsoover was -dofte prior to fransmisslon 
ofthe data. Of those reporting an editing funetion, approximately half do: 
“only a cursory visual. check .for compbeteness or reasonableness compared with . 
‘ the previous year's: report. The remaining states have ostabl|shod mora 
, *. # > ‘extensive’ arithmetic verlftcatlon procedures. J ete ; , : 
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ote .; Sixty percent of the 45’respondents to the state survey (27 +states) : 
Indicated some use of the HEGIS finance data, but many of these Indicated that + 
' the uses were: quite fimited. A recent study comml’ssjoged by NCES on.the uses 
of HEGIS data documents .consIderable use, both direct and Indirect, but  . 
‘mentions, Infrequently the-yse of these data by states...A few states use HEGIS 
“data-to prepare summarles of .revenues and expenditures’ for state planning and. , 
oe budgeting functlongy but most states find thelr own separate data col lectlons 
Son ; to yleldmore detalled and more accurate Informatlon for Internal planning 
. - .purposes. The most sophisticated uses of the HEGIS data are fer Interstate and . 
' _ Intertnstitutlonal comparisons; the use of these Yata for some type of 
' , compat! son was entloned by only 20 percent (9 states) of the respondents. to 
» the state survey. Some-of those states that coordinate the collection of HEGIS 
- data from Independent Igstitutlons mentioned the value.of HEGIS In. providing 
1 the most convenlent source of fInanclal: data on Independent InstItutlons In the: 
_state. Several respondents noted problems ‘In. the comparabllIty of theidata as . 
“a major factor In Impeding the use of data, while others noted lack of 
timeliness Jn. data ‘publication as a factor. This general lack of significant 
use of the data by the states’ In turn undoubtedly affects data quallty by “ 
‘ellmInatMg or reductng Institutional Incentives for accurate reporting. This 
effect -on data quality Is ,compounded‘when there Is little evidence of federal, 
use of the data as well. | _ ao es 
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Use of HEGIS Data’ 
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/ "+ Figure 1 = State HEGIS Coordination = Fal va — - ae os 
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Reporting Universe 


The universes @f Institutions reportiag Jn HEGIS Ts detarminad on. the Pasis 
of accreditation by the federal Department of Education for ell gibtl ity for 
‘* fedural support, rather than on the basls of: grouping Ike Institutlons for, | 
statistical comparisons. The Inconsistency of thls -unlvorse from state to 
state Is most apparent In tha Incluslon of postsecondary, vocatlonal-technical 
Institutes In somo states but not In others. While Intyr institutional 
comparisons ara not affected by this varfation In reporting, the Integr lly, of 
compar lsqns of tha two-year sector from state to state could be Joopardlacd, 


; Approximately half of the respondents to tharstate curvey reported current 
roporating expenditures for postsecondary vucationat-techntdal Institutes not tn 
tho NCES“HEGIS untverso. In 1978-79, 25 stales reported a rango from $749,700 
fo $156,551,352. Tho moan oxpanditure was mora than $22,600, with o pond| tures 
In ten of the states reported at under $5 millon. eg! / 

Tho number of students onrol lod In postsecondary vocatlonal=tochnical - 
Institutes outelda the HEGIS unlverse appears 10 be significant, but tt Is 
difficult to ovaluate the numbers In torms of full-time aquivalont students 
(FTE). While an FIE calculation may vary consi dorably In tradItlonal 
postsecondary Institutions from stato to stato and oven within a singlo state, 
the concept, of -an FIE Is often allen to the vocational education, sector. . | 
Rosponses to tho stato survoy, which asked for FTE enro|imonts assoclated with 
postsecondary vocational-tochnical Institutos not In the HEGIS unlverse, - 
roflocted difficulty In doriving an FTE cgunt. Somo states reported avorago 
dally momborshIps/% or Indicated that all studanfs waro considorod full time. 

It was dotorminod by tho task’ forco that revilewod the state survey results that 
tho onrollmont figures obtalned from‘the ‘survey for all states wero maaningless 
and would be disregarded In the analysls of. survey results. Novertheless, 
table,1 shows the states reporting expenditures for postsecondary . 
voeatlonal-technical Institutes not In tho HEGIS universe, and the assoc lated 
enrollment figures reported by oach state. » . . . 


e 


. ® x. ; : 
Direct Student Ald - 


*. States vary significantly In strategles for ‘providing student assistanco » 


in the form of scholarships, fellowships, grants, and work-study support. In 
some Instances, these funds are provided In part cr In totel to Instbtutions 
for administration and for dJstributlon to students. In other Instances, the 
ald Is provided directly to students, who use It to attend Institutions of 
tholr choice, whether public, “Independent, or oven out-of-state, Stnce HEGIS 
collects Information on. state, appropriations to Insitutions that would Include 
student ald funds channeled through Institutional accounts--If this Is the 
strategy chosen In jthe state--this varletionsin state funding practice can: give 
risa to a problem of comp Mabity when assessing the rovenues and expend! tures 
‘ of Institutions In differen ps. To determine the scope of this probier, 
the state survey asked for-a@mruenti fication of direct state and local. 
government student “ald funding that Is not.administered by institutions and. 
thus does not appear In HEGIS. Forty-one states reported such expenditures, 
ranging. In 1978-679 from $75,100 to $256,830,256. Table 2 shows those stetes 
reporting direct student ald expenditures, with the total collars reported for | 
--1978+79. Most of the student ald was In the form of stholarhsips and grants to 


‘ x : rf 
a ee: a v, 


2 3 LO 


gtudonts attending [n-state, tAdependenat Institutions, with a alightly emal ler 
but still large amount goalng to students attending In-state, public, 
Institutions, Very ,little of the dtract ald was In the form of work-study. 


Central Boards, Commissions, and Off locos of 


An. area whene varlations ware known to occur In the manner of state 
ee and thus: where varlatlons would occur, Ih. reporting practica way ‘through 
the existence of varlous central boards, offices, and commissions, Thase tunds 
In soma cases ara allocated to Instltutlonal accounts and roported In HEGIS; In 
Olhar cases they are handled cantrally and not reported af all. Once agaln, 
tho stotuy survey attempted to address the quostlons of tho prevalence and 


magnitude of those practices. It wos found thot noarly all stotes have some “1 
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ee of education, or a statewlde coordinating board. The most. 
significant variations occur In states where there, Is a single unl vers Ity 
system with a very lorge central system office with governing rosponslbl lity 
for the Institutions. Whun contral office funds are not allocated to the 
Institutions and aro not reported In HEGIS, a problem of conparabl lity wilt 
oxist. If theso contral office funds aro not allocated té the Instl tutions and 
aru not reported In HEGIS, comparabl lity with Institutions, In states Where cach 
Institution has Its own govorning board and whore thosd funds | are roported In 
HEGIS Is Joopardized. Forty-four states reported ‘such eeponeituree iin 1978-79, 
ranging trom $14,857 to $34,458,463 with half reported-at under $2 mi|iion. 
Tho statos whoro disproport lonately large dontral of fico expenditures soem: to / 
-occur aro Alaska, Hawall, Missourl, and=North Carolina, The dollars reported 
for all. such contral ot fice oxpond| tures for 1978-79 aro shown In toble 3. 

In reviewing the question of ‘roporting central office oxpenditures In 
HEGIS, the conclusion was reached that many Institutions aro.not following the 
HEGIS Instructions that spocJfy allocation of these oxpendituros’ to tho 
Individual campuses, becauso of difficulty In dotormIning the appropr late 
allocations. In the case of statewide boards, the campusos rosponding to the 
HEGIS survey general ly,.do not havo accoss to tho board~oxpendituroas flgures amd 
would not bo In a position to determine the appropriate allocations even If tho 
total. SApOnO Tunes woro known. . ~ 


The problem of central befiéa supensed ie only one manifestation of state — 
organizational vartations that cause reporting Inconsistencles. Other 
_organbzational variations, such as the aggregation of ‘al-l’ extension programs ~ 
for a unlversity system: Into a separate roporting unit, cause simiftar reporting 
Inconsistencles.. A more prevalent organizational variation Involves funding 
and enrol Iments for. medical school’s that Include medicine, dentistry, 
osteopathy, and veter Inary medicine programs. In about half the states, these 
figures are commingled with the funding and enroliments for a parent 
Institution, while In the other half a aro ee as funding and * 
onroi|ments for separate Institutions ’ 
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eae. AG a strategy for funding postsecondary education functions, many | states 
“select the option of providing central-ly funded sefvices for all public” | aun 
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*. Because: the funds: do. not flow. through. Institutions, they are general ly’ not. 
2 Sreported: in HEGIS, although HEGIS Instructions spectty Inclusion of al located 
... Shares. of. such funds.~ Twenty=sIx states respond ing to, the state survey, 
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State practices: for the purchase or financing of Capital sequiel+iens' vary. 


‘significantly. “Asa result, In. some states these: purchases. are f.inanced — . 
. entirely separately ‘by. the state ‘and the dol:lars do ‘not appear in Institutional — 
“accounts... - In other. states,’ however, . ‘such purchases. or financial - arrangements — 


for. debt. service are made. directly <-by the: InstItutfons ‘and ‘the dollars appear ~~ 
within current funds revenues. and expenditures reports of ‘the Institution. — 
This creates important problems of comparability ‘when comparing revenues and 
expenditures of Institutions In different states. Other flnancing, vartations ° 


“that result In reducing the validity of this ‘comparison. Include the exp | Icit 


designation of all or a portion of. all, tultion and fees revenues for repayment . 
of capItal. purchases, or the: designat ‘of. auxl | lary enterpr [50 " revenues for 


In preparing the state survey to address problems ce donparallity: that | 
seemed to exist, two approaches were possible. It was recognized’ that » 
comparabI| Ity problems: occurred whenever the HEGIS reports for Institutions in» 


one staté. ncluded funds for a particular. function while the HEGIS. reports for 
a equivalent: Institutions In another state did not. Include funds. for the same. 
-: functlon; . therefore, the survey could elther (1). ask for Identification: of - 
“funds: for those furictions not Included In HEGIS,- or (2) ask for’. those functlons. 
Included In'HEGIS. <In most. cases, It was decd4ded to address the question of. 4 


data gaps, and ask for Identification of funds not Included In: HEGIS.. Because _ 


' of the complex ty of the question of debt service .and the sense’ that HEGIS Is : 


intended primarily to address current’ operating revenues and expenditures, It? 
was decided to elect the other approach In collecting Informatlon on debt 

serv Ice’ arrangements: and to ask for“Identification of Funds: that are - ingruded 
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; , consideration for ‘th analyst or researcher ustrig HEGIS’ data. . Although the 
-"° "= neporting varfations stem primarfly: from Legitimate. differ ces. fn State: ™ 
- strategtes..for funding and ffhancing postsecondary’ educatl n, they pose... 4.0504 ¢ 
-'g{ghlficant. problems’ In’ comparabillty.:.° - hs ee ec 
Ac: 5 4 NS Pe ee 


ae resi NT : eae role of the statés 
: In coordinating, editing, and- using HEGIS data, since’ the level Of. activity by.” 
the, state generally: affects’ the .qual|ty of data: reported yy the Institutions. 


lee Ee 3 : ® ‘, Tes ginih aes : et se ae op. . ; 
- . The researcher or analyst would;be-wise. to. rey kew th 


- _— When using -HEGIS data as the basis. for # sfdy,. It is Important to cs 
©) recognize that finds for a particular..functton may ‘be Included: In the reports °< 

. oc .of Inst tuttons In’ one state but: aot In the reports of Institutions in another 

. oo “state.” "These reporting variations result ‘trom differences In state: funding . 

“8. praétices,-for student-ald funds, funds for postsecondary .vocational-technical 

_ Anstitutes, central boards’ and offices, central support services, ‘and debt — 

_ orice ar ngenents. oe  . rr feces ea ia sa a 
: : ? : i : . ; oe £3" co oe . 7 eo. 

. + Whéen.making compar lsons between institutions, sectors, or. states, It Is 

-\ = Important to ‘select carefully the peer.groups to be used, based On an 8 
, : appropriate Institutional classifi tion’ system, totavold large’ categories 7 


containing significantly dissimilar’ nstitutlons.. 


. 


“ss 


: ' Gl 7 . 
amy The report developed by: the SHEEO/NCES ‘Network Office, on the quality .and 
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